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ABSTRACT 
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A  Markov  step  process  Z  equipped  with  a  possibly  non-den umerable 
state  space  x  can  model  a  variety  of  queueing,  communication  and  com¬ 
puter  networks.  The  analysis  of  such  networks  can  be  facilitated  if 
certain  traffic  flows  consist  of  mutually  independent  Poisson  proces¬ 
ses.  Accordingly,  we  define  the  multivariate  counting  process 
N= (N^yN2 , . . .Nc)  induced  by  Z;  a  count  in  IT  occurs  whenever  Z  jumps 
from  xeX  into  a  (possibly  empty)  target  set  .  We  study  N  through 
the  infinitesimal  operator  A  of  the  augmented  Markov  process  W=(Z,N), 
and  the  integral  relation  connecting  A  with  the  transition  operator 
Tfc  of  W.  It  is  then  shown  that  is  expressed  in  terms  of  a  non¬ 
negative  valued  function  r^  defined  on  x?  ri (x)  may  be  interpreted  as  the 
expected  rate  of  increase  in  N^,  given  that  Z  is  in  sate  x. 

For  univariate  N  (i.e.,  c*l),  we  show  that  N  is  Poisson  iff  (a) 

E  [r (Z (t) ) ]  is  constant  and  (b*)  E  tr  (Z  (t)  >  |N  (t)  ]«E  [r  (Z  (t)  )  ]  for  each 


t>0 .  These  "local"  conditions  are  weaker  than  the  usual  global 
sufficiency  criteria,  which  moreover  require  stationarity  (of  Z)  and 


independence  (of  N(t)  and  Z(t  ^  ^  /v  t"*'  A 

"V  A  multivariate  N  is  Poisson  (i.e.,  composed  of  mutually  inde¬ 
pendent  Poisson  streams  if  each  r^Z)  is  stationary,  and^r7\(Z  (t) ) 
is  independent  of  N(t)  for  each  i  and  each  t^)0.  The  latter  is  already 


much  less  restrictive  than  the  independent  of  N(t)  and  Z(t),  but  we 
IT 


■aa?e  able  to  find  even  weaker  hypotheses  which  are  both  necessary  and 


sufficient  for  N  to  be  Poisson. 


■V 


0 .  INTRODUCTION 


In  earlier  papers,  the  authors  [1] [13] [14]  and  others  [10]  [15] 

[7]  [11]  have  studied  traffic  processes  in  Markov  feedback  queueing  net¬ 
works,  and  more  generally,  traffic  processes  appropriately  defined  on 
regular  Markov  processes  with  a  denumerable  state  space.  One  applica¬ 
tion  has  been  to  Jackson  networks  (exponential  servers,  random  instan¬ 
taneous  routings,  and  independent  Poisson  exogenous  arrival  streams)  in 
equilibrium;  we  have  shown  that  certain  traffic  processes  consist  of 
mutually  independent  Poisson  streams,  while  others — those  within  loops 
or  cycles — cannot  be  Poisson.  The  same  type  of  result  extends  to  more 
general  queueing  networks,  in  the  sense  that  we  have  found  some  neces¬ 
sary  and  sufficient  conditions  that  traffic  processes  are  Poisson  [13] 
[14].  However,  we  know  of  no  prior  result  asserting  complete  necessity 
conditions  for  multivariate  counting  processes  induced  by  a  Markov  step 
process. 

We  are  now  able  to  extend  the  theory  to  apply  to  a  Markov  step 
process  Z  on  a  non-denumerable  state  space  x»  and  to  cover  simultaneous 
sufficiency  and  necessity  conditions  for  both  univariate  and  multi¬ 
variate  counting  processes  N  induced  by  Z.  As  in  [13],  the  notion  of 
traffic  is  abstracted  to  the  less  restrictive  concept  of  jumps  from 
originating  to  target  sets  in  the  state  space;  the  number  of  such 
jumps  constitutes  the  counting  process  under  investigation.  Moreover, 
we  introduce  a  unified  methodology  that  simplifies  prior  approaches. 

Melamed  [13]  has  summarized  arguments  in  the  queueing  system  lit¬ 
erature  purporting  to  show  that  certain  traffic  streams  are  Poisson 
[1] [3] [7] [10] [15] ;  in  each  instance,  the  proof  is  equivalent  to  demon¬ 
strating  the  independence  of  N(t)  and  Z(t)  for  each  t>0  under  the 
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additional  hypothesis  that  Z  is  in  equilibrium.  It  is  now  known  [13] 
that  weaker  conditions  suffice  for  univariate  or  multivariate  N. 
Further,  a  necessity  result  [13]  exists  for  univariate  N.  In  our  work, 
we  shall  find  conditions  that  are  simultaneously  necessary  and  suffi¬ 
cient  for  both  univariate  and  multivariate  N. 

The  "global”  nature  of  the  independence  between  N(t)  and  Z(t) 
fails  to  discriminate  between  parts  of  Z  relevant  to  N,  and  those 
aspects  of  Z  having  no  influence  on  N  at  all.  It  is  thus  intuitively 
plausible  that  the  usual  sufficiency  conditions  can  be  improved,  and 
necessity  also  considered.  It  turns  out  that  "local"  criteria  for  a 
Poisson  N  can  indeed  be  derived.  To  this  end,  we  augment  the  Markov 
step  process  Z  to  incorporate  the  traffic  N  via  the  new  Markov  step 
process  W=(Z,N).  We  study  N  through  the  infinitesimal  operator  A  of 
W,  using  the  integral  relation  connecting  A  with  the  transition  opera¬ 
tor  Tfc.  In  this  fashion,  we  elucidate  the  properties  of  a  non-negative 
function  r  (for  univariate  N)  defined  at  least  on  the  domain  of  A.  We 
can  interpret  r(x)  as  the  jump  rate  of  N,  given  that  Z  is  in  state  x. 
For  univariate  N,  we  find  N  to  be  Poisson  iff  (a)  the  expectation 
E[r(Z(t))]  is  constant,  and  (b*)  the  conditional  expectation 
E[r(Z(t) ) |N(t) ]=E[r(Z(t) ) ]  for  each  t>0. 

For  multivariate  N* (N1,N2# • • . ,NC) ,  it  is  proved  in  Section  III 
that  extensions  of  (a)  and  (b*)  suffice  for  the  to  be  mutually 
independent  Poisson  streams.  However,  an  even  less  restrictive  set 
of  conditions  are  discovered  to  be  both  sufficient  and  necessary  in 
the  same  regard.  Another  set  of  conditions  is  shown  to  be  equivalent 
to  the  latter  set.  In  each  of  these  cases,  the  specified  conditions 
reduce  to  (a)  and  (b*)  when  c«l,  i.e.,  when  N  is  actually  univariate. 
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We  stress  that  each  of  the  results  quoted  above  are  applicable 
to  Markov  step  processes  on  denumerable  as  well  as  non-denumerable 
state  spaces.  This  generalization  over  [3]  [4]  [7]  [10]  [11]  [13] [15] 
does  not  entail  any  sacrifice  in  the  strnegth  of  the  conclusions 
obtained,  nor  does  it  require  a  more  complicated  analytic  methodology. 
Although  it  is  not  customary  to  contemplate  pure  jump  Markov  queueing 
or  storage  systems  on  non-denumerable  state  spaces,  it  is  easy  to 
visualize  models  of  systems  that  are  essentially  non-denumerable. 

These  might  involve  variable  magnitude  or  partial  service,  as  well 
as  processing  of  units  (e.g.,  messages  or  rainfall)  of  random  size. 

As  for  multivariate  N,  we  remark  that  its  analysis  has  already  led 
to  the  construction  of  a  maximal  decomposition  for  Jackson  networks 
[1],  and  that  there  may  well  be  new  applications  to  respective  counting 
processes  generated  by  multiple  classes  of  service  and/or  customers . 


I .  PRELIMINARIES 

Our  intent  is  to  analyze  a  counting  process  N  induced  by  a 
Markov  jump  process  Z.  We  shall  need  some  standard  notions  applicable 
to  such  processes;  these  are  stated  without  detailed  explanation,  but 
with  sufficient  references  to  aid  the  reader  unfamiliar  with  the  mat¬ 
erial.  For  Z,  we  suppose  a  state  space  x  equipped  with  a  o-algebra  B 
and  the  discrete  topology.  In  the  terminology  of  Dynkin  ([6],  p.  93), 
Z  is  required  to  be  a  step  process.  The  weak  infinitesimal  operator 
A  of  Z  ([6],  Section  1.6)  is  a  (possibly  unbounded)  transformation 
with  representation  ([6],  Section  V.2) 
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(Ag) (x)  -  -q(x)g(x)  +  q (x)/  Q(x,dy)g(y),  xex*  (1.1) 

X 

Here  A  is  a  mapping  from  a  subset  of  ft  into  b ,  b  being  the  set  of 
bounded  real-valued  functions  on  (x,f>)  .  Moreover,  Q  is  measurable 
separately  in  each  variable,  with  Q(x,x)=l  for  each  xeX-  We  remark 
that  Q(x,D  is  regarded  as  the  probability  that  a  jump,  starting  from 
x,  will  take  Z  into  r.  The  function  q  is  the  jump  rate,  q(x)  being 
the  parameter  of  the  exponentially  distributed  sojourn  time,  given 
that  Z  is  at  x. 

To  preclude  trivialities,  we  specify  that  there  be  no  absorbing 
states;  then  0<q(x)<»  for  the  step  process.  Under  the  stronger  hypo- 
thesis--met  by  most  practical  systems — that  sup [q (x) ] <®,  a  becomes  an 
endomorphism  which  is  identical  with  the  strong  infinitesimal  operator 
([12],  p.  643).  Otherwise,  we  are  forced  to  simply  assume  that  the 
indicators  gei)  to  appear  hereafter  lie  in  the  domain  of  the  weak 
infinitesimal  operator  A.  This  cannot  be  guaranteed,  as- is  indicated 
by  the  example  of  the  departure  process  from  the  simple  M/M/°°  queue. 

Our  principal  concern  is  a  counting  process  N  generated  by  Z. 

A  count  occurs  whenever  Z  jumps  from  x  directly  into  r  where  r  is  a 
(possibly  empty)  measurable  subset  of  x  such  that  x^r^.  in  terms  of 
the  notation  established  for  (1.1),  Q(x,r  )  is  the  probability  that  a 
next  jump  of  Z  increments  N.  To  place  this  notion  in  a  suitable  con¬ 
text,  augment  Z  to  the  new  Markov  process 

W  =  (Z,N)  (1.2) 

on  a  state  space  x*N+,  where  N+  is  the  set  of  non-negative  integers. 

On  the  new  state  space,  the  a-algebra  is  that  generated  by  r*{k}, 

T e'F,  keN+.  The  infinitesimal  operator  A  for  W  is  defined  by  (1.1) 
with  the  same  rate  function  q,  but  with  Q  replaced  by 
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,Q  (x,  D  6 


Q ( (x,n) ,Tx{k}) 


n+1  ,k 


Q  ( x ,  T )  6 


(1.3) 


rnr  =<j> 

X 


where  6  is  the  Kronecker  delta.  If  we  take  g(x,n)  =  g(x)  and  use 

(1.3)  in  (1.1)/  we  see  that  (Akg) (x)  *  £(Akg)(x,n)  for  each  k-1,2,...; 

n 

hence,  by  the  exponential  formula  of  semi-group  theory  the  transition 
probabilities  P  and  P  are  related  by 

00 

p(t,x,n  *  l  p (t,  (x,o) ,  rx{n})  =  p(t,  (x,o)  ,txn+)  .  (i.4) 

n=0 

The  projection  of  W  on  x  then  has  the  same  probability  structure  as  Z, 


provided  that  the  initial  probabilities  are  related  by 
<pQ  (A)  *  <po(Ax{0})  , 


(1.5) 


where  and  <pfc  are  the  probability  measures  of  Z  (t)  and  W(t)  ,  respect¬ 
ively.  In  (1.5),  N(0)»0  almost  surely  is  assumed  as  a  matter  of  con¬ 


venience. 


Thus,  W  is  an'  augmentation  of  Z  by  the  counting  process  N.  More¬ 
over,  the  argument  of  Theorem  1  in  [1]  is  applicable  to  show  that  w 
retains  the  Markov  property  as  well  as  the  step  process  behavior.  In 
fact,  we  have 

Theorem  1.1;  W  is  a  Markov  step  process  whose  weak  infinitesimal 
operator  A  is  represented  by  (1.1),  with  functions  Q  given  by  (1.3) 
and  q (x, n) *q (x) .  If  q  is  bounded,  A  is  an  endomorphism  on  the  bounded 
measurable  functions  on  xxN  >  if  ^omain  of  A) ,  and  h  is  a 

bounded  function  on  N+,  then  ghej’^.  Under  the  hypothesis  (1.5) 


n  -  n  + 

P(n(x(tk)erk}]  -  Pin  e  (rk*ii  )  }] 

for  all  collections  of  tk  and  measurable  rk» 


(1.6) 


We  now  complete  this  Section  by  listing  several  standard  rela¬ 
tions  ([6],  Chapter  2)  appropriate  to  our  purpose.  Starting  from  the 


transition  probability,  we  can  define  the  semi-group  of  transition 
operators  on  jh  by 

(T. g) (w)  »  / P(t,w,dy)g(y)  (1.7) 

where  Tv  =xxN+-  The  Tfc  have  the  probabilistic  interpretation 

(Ttg)  (w)  *  E[g(w(t) )  |W(0)=w]  (1.8) 


where  E  denotes  an  expectation.  Each  feh  induces  a  linear  functional 
on  the  space  of  bounded  signed  measures.  Specifically,  we  obtain 


(T.g,<p  )  =  /  (T  g)  (w)  (p  (dw)  =  E[g(W(t))] 
c  °  y  z  ° 

In  particular,  if  we  choose 
1  wexx{n) 


gn(w)  - 


(1.9) 


(1.10) 


otherwise 


we  shall  have 

(Tt9n,<po)  =  P  (N (t)  =n] .  (1.11) 

In  the  remainder  of  this  paper,  we  will  make  repeated  use  of 
the  standard  identity  ([6],  p.  40) 


t 

(T  g) (w)  =  g (w)  +  /  dr/  P (x,w,dy) (Ag) (y)  (1.12) 

*  o  y 

which,  when  W(0)  has  probability  measure  <pQ,  yields 

t 

E[g(W(t))]  *  (g,<p  )  +  /  dr  /  P  (x,dy)  (Ag)  (y)  ,  (1.13) 

0  K 

where  we  have  defined  P(x,A)*P [W(x) eA]  and  P (x ,w, A) *P [W(x) eA |W(0) «w] . 
As  we  shall  see,  the  evaluation  of  (1.13)  for  a  g;  of  the  form  (1.10) 
and  a  Markov  step  process  in  probability  equilibrium  is  relatively 


i 


easy,  and  sheds  light  on  the  properties  of  the  traffic  process  N. 


II.  CONDITIONS  FOR  POISSON  COUNTING  PROCESSES 

We  begin  by  specializing  (1.13)  for  the  gn  specified  by  (1.10); 
this  leads  directly  to  an  expression  for  P[N(t)=n].  First,  gn  is 
substituted  into  (1.1)  applied  to  W,  so  that  we  find  for  y=(x,k) 
(Agn)(y)  -  q(x)Q(x,rx)[5lttn.:l-4k>n].  (2.1) 

Substituting  (2.1)  into  (1.13)  yields  the  basic  formulas 


t 

P [N ( t ) =0 ]  =  1  -  /  d tJ  q(x)Q(x,T  )P(t,dx,0)  (2.2a) 

0  X 

and 


P[N(t)-n] 


/  q  (x)  Q  (x, r  )  tP(T,dx,n-l)-P(r,dx,n) ] 

X 

(2.2b) 


for  n»l.  In  the  above,  we  have  adopted  notation  consistent  with  (1.13); 
P (t ,A ,n) *P [Z (t) eA ,N (t)=n] .  These  two  equations  can  be  added  together 
and  the  complement  taken  to  produce  the  simpler 

t 

P [N (t) >n]  -  /  dT  /  r(x)P(x,dx,n)  (2.3) 

0  X 

in  which  we  have  used  the  more  compact  notation 

r (x)  *  q(x)Q(x,rx) ;  (2.4) 

evidently,  r(x)  is  (intuitively  speaking)  the  rate  of  the  counting 
process,  assuming  that  the  Markov  process  Z  is  in  state  x.  Furthermore, 
r(Z(t))  may  be  thought  of  as  the  rate  of  the  counting  process  N  at  time 
t,  and  its  expectation  E[r(Z(t))]  as  the  intensity  of  N  at  that  time. 

We  mention  these  interpretations  at  this  juncture,  because  r  is  in  fact 
a  crucial  parameter  of  N. 
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To  relate  r  to  the  counting  process  N,  we  shall  begin  by 
defining  some  a-algebras  relevant  to  stationarity  and  independence 
properties  involving  r  and  N.  We  define  the  a-algebra  'fi^=o{U  (u)  ,ust} , 
and  observe  that  "“/?tc^=o{Z  (u)  ,u<t} .  We  note  further  that  the  events 
{N (t)  -N (s)  =n}e 5-^=0 {Z  (u)  , u>t} .  With  this  notation,  we  claim 

Af. 

Lemma  2.1:  Let  Ae3-  .  Then  almost  surely 

E(A|71t)  *  E  E  (A  |  Z  (t) )  |7?fc]  =  E[E(A  |^t)  |7lfc]  (2.5) 

Proof:  By  the  Markov  property  for  Z,  E (A | Z (t) )=E (A \$t)-E (A | 5^*7^) • 
Conditioning  again  on  V)  and  using  the  fact  that  the  conditioning 
reduces  the  right  hand  expression  to  E(Aj7)t)  yields  (2.5).  □ 

Lemma  2.2:  For  0<s<t  we  have  almost  surely 

t 

E[N(t)-N(s)  \\]  »  /  E[r(Z(t)  )  |7)e]dT  (2.6) 

s  s  s 

Proof:  If  Wg (u) ■ (Z (s+u) , [N (s+u) -N (s) ] ) ,  then  W  is  a  Markov  process 
with  the  same  statistics  as  W.  We  may  substitute  (2.1)  into  (1.12) 
to  obtain  an  expression  for  P [N (t) -N(s)=n | Z (s) ] ,  and  proceed  as  in 
(2.3)  to  calculate  P  [N  ( t)  -N  (s)  >n  |  Z  (s )  ]  .  Since  P[N(t)<°°]=l,  the  con¬ 
ditional  expectation  E [N(t) -N(s) | Z  (s) ]  follows  by  summing  over  n;  the 
summation  process  is  valid  under  the  integral  sign  according  to 
Fubini's  theorem.  Thus  we  find 

t 

E[N(t)-N(s)  |Z(s)  ]  -  /  E  [r  (Z  (t)  )  j  Z  (s)]dt .  (2.7) 

s 

To  reduce  (2.7)  to  (2.6),  integrate  both  sides  of  (2.7)  over  A e^g 
with  respect  to  probability  measure,  using  again  Fubini's  theorem  on 
the  right  side.  Reference  to  Lemma  2.1  then  completes  the  argument,  q 
It  is  easy  to  calculate  the  expectation  of  N  from  (2.6)  or 
(2.7).  Taking  the  expectation  of  both  sides  of  either  of  these 
equations  leads  to 


(2.8) 


t  t 

ElN(t)  *  /  E  [r  (Z  (  t)  )  ]  dr  =  /  (r,^  )dr. 

0  0  T 

Clearly,  (2.8)  simplifies  if  Z  is  in  equilibrium,  that  is,  if 
P[Z(t)er]  is  constant  for  t^O  and  any  fixed  Vc'B.  We  note  that  equil¬ 
ibrium  is  equivalent  to  each  of  the  following:  (g , )  is  constant, 

(Ttg,i pQ)  is  constant,  or  (Ag,^Q)=0  for  each  gc)b;  this  equivalence  is 
easily  shown  for  Feller  processes.  A  more  restricted  version  of  the 
above  is  given  by 

Definition  2.3:  For  a  qz)i,  Z  is  in  g-partial  equilibrium  if  (g,ipt) 
is  constant  for  all  t>0  [or  equivalently,  if  (Ttg,^Q)  is  constant, 
or  (Ag,i|>o)=0] .  D 

Evidently,  g-partial  equilibrium  is  a  local  steady  state  condition 
that  permits  arbitrary  (nonstationary)  behavior  of  parts  of  the  Markov 
process.  In  particular,  r-partial  equilibrium  requires  that  the  part 
of  Z  relevant  to  N  be  in  a  steady  state  condition.  It  may  be  expected 
that  N  experiences  homogeneous  growth — and  is  hence  a  candidate  for  a 
Poisson  process — if  Z  is  in  r-partial  equilibrium. 

For  N  to  be  Poisson,  it  is  also  necessary  that  the  future  and 
past  of  N  be  independent;  more  precisely,  (N(t)-N(s)]  is  independent  of 
~/ig  for  all  OSsSt.  We  shall  see  that  a  notion  relevant  to  the  appropriate 
independence  is 

Definition  2.4:  For  a  gzfi,  Z  is  g-partially  independent  of  N  if,  for 
every  t20 ,  E[g(Z(t) )  |Ht3=E  [g  (Z  (t) )  3  .  □ 

It  is  clear  that  Z(t)  is  independent  of  -/]t  iff  Z  is  g-partially  inde¬ 
pendent  of  N  for  every  g,  and  that  the  independence  of  g(Z(t))  and  7? 
is  equivalent  to  g-partial  independence  if  g  is  an  indicator  function. 
With  the  aid  of  Definitions  2.3  and  2.4,  we  can  assert  conditions  under 
which  N  is  a  Poisson  process. 
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Theorem  2.5;  N  is  a  Poisson  process  if  and  only  if 

(a)  Z  is  in  r-partial  equilibrium,  and 

(b)  Z  is  r-partially  independent  of  N. 

Proof:  We  shall  make  repeated  use  of  Watanabe's  theorem  ([5],  p.  76), 
which  states  that  a  counting  process  is  Poisson  iff 

E[N(t)-N(s)  |7lg]  -  X(t-s)  (2  9) 

for  0<s<t.  This  is  in  turn  equivalent  to  the  independence  of 
[N (t)  -N (s)  ]  and  %>  together  with  E  [N  (t)  -N(s)  J»A  (t-s)  . 

Suppose  now  that  (a)  and  (b)  are  satisfied.  If  (b)  and  (a)  are 
successively  applied  to  the  integrand  in  (2.6),  that  integrand  beaorres  (r ,if>Q),  which 
we  call  A.  This  proves  (2.9),  and  with  it  sufficiency.  To  demonstrate 
necessity,  observe  that  if  N  is  a  Poisson  process  of  intensity  A,  the 
left  side  of  (2.6)  becomes  A(t-s)  according  to  (2.9).  Since  r  is 
bounded  (as  it  must  be  to  belong  to  $A)  and  a  right  continuous  step 
function,  we  may  divide  both  sides  of  (2.6)  by  (t-s)  and  take  limits 
as  tvs.  The  limiting  operation  yields  E [r (Z (s) ) ]71  1=A  almost  surely, 
whence  (b)  follows.  Taking  the  expectation  of  E  [r  (Z  (s) )  \Tl^}  then 
leads  immediately  to  (a) .  D 

A  recent  paper  concerned  with  Poisson  traffic  flows  on  denumer¬ 
able  state  Markovian  systems  introduces  the  concept  of  weak  pointwise 
independence  ( [13] ,  Section  5) ,  which  plays  the  role  of  our  r-partial 
independence  in  our  Theorem  2.5.  In  a  sense,  weak  pointwise  independence 
is  a  more  desirable  condition,  since  it  involves  only  independence  of 
N(t),  and  not  of  “fl  (the  entire  past  of  N)  .  We  shall  be  able  to 
strengthen  our  results  similarly,  referring  to  N(t)  rather  than  “tl  for 
necessity  and  sufficiency. 
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Definition  2.6:  (compare  Definition  2.4  and  subsequent  comments). 

For  a  ge$,  Z  is  weakly  g-partially  independent  of  N  if,  for  every  t>0, 
E[g(Z(t) )  |N(t)  )=E(g(Z(t) )  ]  .  Q 

Theorem  2.7;  The  conclusion  of  Theorem  2.5  continue  to  hold  if  (b)  is 
replaced  by  (b*) .  In  particular,  (a)  and  (b*)  imply  (a)  and 
(b)  . 

Proof:  Necessity  of  (a)  and  (b* )  is  obvious,  because  (b)  implies  (b*)  • 
To  demonstrate  the  sufficiency  of  (a)  and  (b*) ,  write  (2.2a)  and  (2.3) 
in  the  form 


t 

P[N(t)=0[  *  1  -  /  E[r(Z(T))I(T,0)]dT  (2.10) 

0 

and 


t 

P [N (t) >n]  =  /  E[r(Z (t) )I (t,n) ]dt  (2.11) 

0 

in  which  I(x,n)  is  the  indicator  function  of  the  event  {N(x)=n}.  That 
E[r(Z(f)  )  I  (t  ,  n)  ]-E[r(Z(r) )  ]E[I(t,n)  ]  is  a  consequence  of  (b*)  ,  and  (a) 
states  that  E[r(Z(r))]  is  constant,  say  equal  to  X.  Hence,  (2.10)  and 
(2.11)  become 

t 

P[N(t)*0]  =  1  -  X  /  P [N (t) =0] dT  (2.12) 

0 

and 

t 

P [N (t) >n]  *  X  /  P [N (x ) ®n] dx •  (2.13) 

0 

We  shall  deduce  from  (2.12)  and  (2.13)  that  the  inter-jump  intervals 
of  N  are  mutally  independent  and  exponentially  distributed.  To  this 
end,  call  Tk»inf {t:N(t)»k>,  and  let  sk*Tk+1“Tk  so  that  Tn  becomes  the 


£ 
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n 

sum  of  inter-jump  times,  i.e.,  T  *£s.  .  The  set  equality  {N (t) =0 }={S, >t} , 

n  ^  k  x 

together  with  the  (unique)  solution  of  (2.12)  yields  as  a  density  func¬ 
tion  for  the  function  f^(t)=Ae  Xt.  We  now  proceed  by  induction  to 

show  that  Tn  is  distributed  according  to  the  n-fold  convolution  of  den¬ 
sities  f  . 

n 

First,  consider  that  {N (t) >n}={Tn+^<t} ,  so  that  Tn+1  has  a  pro¬ 
bability  density  according  to  (2.13).  From  the  same  equation,  using 

{N(tj=n}={T  <t}-{T  ..<t},  we  obtain 
n  n+x 

fn+l(t)  *  XfPn(t)  -  Fn+l(t)]  (2*14) 

in  which  f  and  Fn  represent  respectively  the  probability  density  and 

probability  distribution  fucntions  of  T  .  To  complete  the  inductive 

argument,  we  turn  to  the  Laplace  transforms  f  of  the  fR. 

For  T^ ,  S^fs)*  Suppose  now  Tn  has  generating  function 

fn  (s)  =  Then,  using  the  generating  function  version  of  (2.14), 

^  X  n+1 

we  find  that  f  ^  (s)*  is  the  unique  solution  of  (2.14). 

The  last  assertion  of  the  Theorem  follows  readily:  if  (a)  and 
(b*)  are  valid,  N  is  a  Poisson  process,  whence  (a)  and  (b)  hold  by 
Theorem  2.5.  0 

Corollary  2.8:  If  Z  is  in  probability  equilibrium,  and  if  N(t)  is 
independent  of  Z(t)  for  each  t^O,  N  is  a  Poisson  process. 

The  Corollary  is  obvious  in  view  of  Theorem  2.7,  although  the 
independent  increment  property  of  N  is  easy  to  prove  directly  from 
the  independence  of  N(t)  and  Z(t).  In  fact,  for  any  Ae'j^,  the  Markov 
property  yields  almost  surely 

P  [Af)  {N  (t)  *n  }  |  Z  ( t)  ]  *  P[A  |  Z  ( t)  ]P[N(t)-n|Z(t)  ]  .  (2.15) 

The  second  term  on  the  right  reduces  to  P[N(t)*n]  by  virtue  of  the 
hypothesis.  If  we  than  take  the  expectation  of  both  sides  of  (2.15), 
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we  obtain  the  result  P [AH{N {t)=n} ]=P (A) P [N (t) *n] ,  as  required. 

Corollary  2.8  presents  global  stationarity  and  independence 
conditions,  whereas  the  conditions  (a),  (b)  and  (b*)  appearing  in 
Theorems  2.5  and  2.7  reflect  only  the  local  relationships  pertinent 
to  N.  It  is  therefore  natural  that  the  conditions  of  Corollary  2.8 
are  not  necessary  for  N  to  be  a  Poisson  process.  We  now  give  an 
example  in  which  N  is  Poisson,  but  neither  of  the  hypotheses  of 
Corollary  2.8  are  satisfied. 

A  system  consists  of  two  exponential  servers  in  tandem,  with 
respective  service  rates  and  queue  lengths  Z^.  We  suppose  that 
the  input  to  the  first  server  is  a  Poisson  stream  of  intensity  A, 
with  0<a2<A<cr^.  We  assume  further  that  Z2(0)=*0,  while  Z^fO)  has 
equilibrium  distribution  appropriate  to  an  M/M/1  queue  with  input 
rate  A  and  service  rate  a^.  As  is  well  known  [3] ,  the  departure  stream 
N  from  the  first  server  is  Poisson.  Nevertheless,  Z=(Z^,Z2)  is  not  in 
equilibrium — indeed,  Z  has  only  transient  states.  Moreover,  Z2(t)=0 
if  N(t)=0,  and  in  fact,  Z2  depends  on  N  for  any  initial  distribution 

Z2 ' 

III.  MULTIPLE  COUNTING  PROCESSES 

In  this  Section  we  extend  the  theory  of  Section  II  to  simultan¬ 
eous  counting  processes,  as  represented  by  the  vector  N*(N^,N2, . . . ,NC) , 
each  N^  being  itself  a  counting  process  induced  by  the  Markov  process 
Z.  The  vector  process  N  is  said  to  be  Poisson  if  each  N^  is  a  Poisson 
stream,  and  if  the  N^  are  mutually  independent  random  processes.  Our 
interest  lies  in  finding  necessary  and  sufficient  conditions  under  which 
N  is  Poisson. 


As  before,  we  define  to  increase  its  count  by  one  whenever 
the  step  Markov  process  Z  passes  directly  from  x  to  .  In  con¬ 
sistency  with  our  former  notation  (2.4),  we  shall  call 

r^x)  =  q(x)Q(x,r^i}),  (3.1) 

which  is  heuristically  interpreted  as  the  counting  rate  of  IT,  given 
that  Z  is  in  state  x.  Conditions  that  each  N.  be  a  Poisson  process 
are  described  in  terms  of  the  corresponding  r^  by  Theorem  2.7  via 
r^-partial  equilibrium  and  weak  r^-partial  independence.  However, 
these  individual  r^  cannot  reveal  any  information  on  the  mutual  inde¬ 
pendence  of  the  Ni* 

Our  results  require  one  restriction  met  by  all  potential  appli¬ 
cations  of  which  we  are  aware.  Throughout  this  Section  we  shall  assume 
the  validity  of 

Hypothesis  3.1:  The  IT  are  disjoint  counting  processes  if,  for  each 
xex,  the  r^i) ,  i=l,2,...,c  are  disjoint  sets.  □ 

If  now  the  original  Markov  process  is  augmented  to  W=(z,N),  we  have 
for  W  (cf.  (1.3)) 


0((x,n) ,r*{k})  *  { 


j'Q(x,D  5 

Iq(x,D5 


along  coordinate  i,  and  F 


(i) 


rcr 

n+e^,k 

rcr( 

n,k 

*n2 , » •  • 

,nc),  e 

-  ur (i) . 

Note 

i  x 

(i) 


(3.2) 


of  the  plays  a  crucial  role  in  the  definition  of  Q. 


We  continue  to  proceed  as  in  Section  I.  To  compute  probabilities 
of  the  count,  it  is  convenient  to  define 
1  wexx(n1,n2, . . .  ,nj 


«n(w)' 


(3.3) 


otherwise 


For  this  g  and  with  the  benefit  of  Hypothesis  3.1,  we  have 
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<Agn)(y)  -  ^  4n,kJ 


(3.4) 


c 

I 

i=l  “  ”  ~i' 

in  which  A  is  the  infinitesimal  operator  of  W  and  y=(x,k).  Next, 
(3.4)  is  substituted  into  (1.13)  to  produce  for  9= (0,0, . . . ,0) 


c  t 

P[N(t)-0]  »  1  -  I  /  E[r.  (Z(T))I(T,0]dt 

i=l  0  1 


(3.5) 


and  for  n^9 


c  t 

P[N(t)=n]  =  l  /  {E  tr.  (Z (x)  )l  (t,n-e. )  ]-  E[r .  (Z  (t)  )  I  (t,n)  ]  }dt; 
i=l  0  1  1  1 

(3.6) 

Here  the  indicator  I  is  defined  as  in  (2.10)  and  (2.11),  with  the 
proviso  that  I(T,n-e^)*0  if  n^*0. 

With  the  aid  of  these  two  expressions,  we  can  adapt  Theorem  2.7 
to  multiple  streams. 

Theorem  3.2:  N  is  Poisson,  the  Ni  having  respective  rates 

X.  -  E[ri(Z(0)]  (3.7) 

provided  that  for  each  i,  i*l,2,...,c 

(a)  Z  is  in  r^-partial  equilibrium,  and  (3.8) 

(b*)  Z  is  weakly  r^-partially  independent  of  N.  (3.9) 

Remark:  This  Theorem  does  not  claim  necessity.  Assumption  (b*)  should 
be  taken  to  mean  that  the  r^(Z(t))  are  each  (pairwise)  independent  of 
the  vector  process  N  at  every  t>0. 

Proof:  It  follows  directly  from  Theorem  2.7  that  the  respective  N^  are 
Poisson  processes  whose  rates  are  specified  by  (3.7).  It  remains  to  show 
that  the  N^^  are  mutually  independent.  To  this  end,  apply  the  hypothe¬ 
ses  of  the  Theorem  to  (3.5)  and  (3.6);  these  then  reduce  to 


P [N (t) “Q ] 


1  - 


t 


X 


l 


P[N(r)-9]dT 


(3.10) 
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an  d 


t  c  t 

P[N(t)=n]  +  X  /  P[N(x)=n]dT  -  l  X.  /  P  [N  (t)  =n-e .  ]  dr  , 

0  i=l  1  0  1 

(3.11) 

where  X=EX^.  These  equations  have  as  their  unique  solution 

n. 

c  (X.t)  x 

P[N(t)=n]  =  H  { — i— j —  exp [-X .  t]  } ,  (3.12) 

i*l  ni*  1 


so  that  the  N^(t),  i*l,2,...,c  are  mutually  independent  for  every 
(fixed)  t. 


We  must  further  prove  that  N  is  a  process  of  independent  incre¬ 
ments.  For  this  purpose,  we  define  Wu  as  in  the  proof  of  Lemma  2.2, 
and  reiterate  the  arguments  of  the  proceding  paragraph  to  demonstrate 
that  N ( t+u) -N (u)  has  the  same  distribution  as  N (t) =N (t) -N (0) .  From 

A 

(3.12),  the  generating  function  f,  defined  by 

f„  ,,  ( 3 )  58  E  [exp{-sT  (N  (v) -N  (u)  )  }  J  ,  0  <  u  <.v  (3.13) 

T  T 

with  N  regarded  as  a  column  vector  and  s  the  row  vector  s  »(s,  ,s_, . . .  ,s  ), 

12  c 

is  then 

fu,v<s>  *  exp{  (v-u)  [EX^xpf-s^  -X]}.  (3.14) 

The  independent  increment  character  of  N  is  now  an  immediate  consequence 
of  the  form  of  £  „  (see  [12],  Sections  37.1  and  37.3). 

Uf  V 

The  hypotheses  of  Theorem  3.2  are  considerably  weaker  than  we  might 
have  anticipated.  For  one  thing,  the  equilibrium  requirement  (a)  is  no 
more  stringent  than  the  necessity  condition  imposed  in  Theorem  2.5  on 
each  individually.  More  surprising,  however,  is  the  independence 
assumption  (3.9),  which  requires  neither  the  N^(t)  nor  the  r^(Z(t))  to 
bo  stochastically  independent;  rather,  the  mutual  independence  of  the 
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N^(t)  (and  indeed,  the  processes  N^)  is  a  natural  outcome  appearing 
in  the  course  of  the  proof. 

Nevertheless,  we  shall  assert  even  weaker  sufficiency  conditions 
for  N  to  be  Poisson;  moreover,  the  same  conditions  are  also  necessary. 
In  particular,  the  independence  hypothesis  (b*)  in  Theorem  3.2  is 
replaced  by  the  less  restrictive 
c 

l  {E  [r .  (Z (t) ) I (t ,n-e. ) ]  -  A.E [I (t,n-e . ) ] } 

i-1  1  11  1 

b’.  (3.15) 

c 

»  {  l  E  [r .  (Z  (t) )  I  (t  ,n)  ]  }  -  AE  [I  ( t ,n)  ]  . 
i-1  1 

for  all  n-(n.  ,n~, . . . ,n  )  and  all  t>0. 
l  2.  c 

Before  proceeding  to  a  proof  of  sufficiency  and  necessity,  we 
make  three  remarks  concerning  (b ' )  above.  First,  in  the  presence  of 
(a)  (cf.  (3.8)),  (b*)  (cf.  (3.9))  implies  that  both  sides  of  (3.15) 
are  zero;  hence,  (b')  follows  from  (b*).  On  the  other  hand,  for  a 
single  stream  (b')  and  (b*)  coincide  in  the  presence  of  (a),  as  is 
readily  shown  by  an  inductive  argument  on  (3.15).  Second,  the  induc¬ 
tive  argument  fails  for  multiple  streams  (i.e.,  c>2)  because  successive 
sums  on  the  left  side  of  (3.15)  are  incomplete.  Indeed,  we  have  been 
unable  to  derive  any  necessity  statement  claiming  stronger  independence 
requirements  on  N(t)  and  Z(t).  Finally,  we  observe  that  necessity  has 
generally  been  less  well  understood  than  sufficiency.  We  know  of  no 
other  necessity  conditions  for  multiple  processes  to  be  mutually  inde¬ 
pendent  Poisson.  Even  for  a  single  process,  the  usual  sufficiency 
hypotheses  are  not  also  necessary.  To  illustrate  this  statement,  we 
observe  that  detailed  balance  implies  reversibility  (91 ,  from  which  one 
concludes  that  a  Poisson  input  in  equilibrium  leads  to  a  Poisson  output 
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(see  [16]/  or  recall  the  M-M  property  in  [15]).  Nevertheless,  the 
converse— necessity— is  false;  a  simple  tandem  M/M/1  queue  has  the 
M-M  property,  but  is  neither  reversible  nor  detail  balanced. 

We  now  proceed  to 

Theorem  3.3:  N  is  Poisson  if  and  only  if  (a)  and  (b')  hold. 

Proof:  To  show  sufficiency,  we  simplify  (3.5)  and  (3.6)  by  introducing 
(a)  and  (b * ) .  The  resulting  relations  are  (3.10)  and  (3.11),  so  that 
the  remainder  of  the  argument  follows  the  proof  of  Theorem  3.2  verbatim. 

If  N  is  Poisson,  the  necessity  part  of  Theorem  2.7  applies  to  each 
N^,  so  (a)  holds,  the  respective  rates  X^  being  specified  by  (3.7).  Now 
differentiate  (3.5)  and  (3.6),  observing  that  the  integrands  are  con¬ 
tinuous  from  the  stochastic  continuity  of  Z.  Differentiation  thus 
yields  the  single  set  of  equations 

a  c 

2--{E[I  (t,n)  ]  }-  l  {E[r.  (Z(t))I(t,n-e.)]-E[r.  (Z  (t) )  I  (t  ,n)  ]  } . 
ut  i«l  1  *• 

(3.16) 

But  the  probability  P[N(t)=»n]»E[I  (t,n)  ]  is  furnished  by  (3.12),  from 
which 

j  c 

5r(E[I(t,n)] }-  l  X . (E  [I (t,n-e. ) ]-E  [I  (t,n) ] } .  (3.17) 

ac  i-i  x  1 

Elimination  of  the  derivative  between  (3.16)  and  (3.17)  then  verifies 

(b').  a 

Let  us  consider  briefly  the  new  condition  (for  all  n) 
c 


l  E [r . (Z (t) )  |N(t)»n]  *  X  and 
i»l 


b*. 


(3.18) 


l  {E[r, (Z(t))l(t,n-e<) ]  -  X . E [I ( t , n-e . ) ] 
i-1  1  11  *■ 


ritMttMsiitiliaiilUllfitititili 
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Some  implications  involving  (b+)  are:  (a)  and  (b*)  =*  (b+) =» (a)  and 
(b1).1  Therefore,  (b+)  suffices  for  N  to  be  Poisson,  but  we  have  been 
unable  to  prove  that  (b+)  is  necessary.  Our  best  result  in  that  dir¬ 
ection  is  an  asymptotic  one,  namely 
Corollary  3.4:  If  N  is  Poisson 

l  E[r.  <2  (t ) )  |N(t)=n]-A  ■  0(t  x)  as  (3.19) 

i=l  1 

for  all  n. 

Remark:  It  is  trivial  that  both  sides  of  (3.15)  tend  toward  zero  as  t 
tends  to  infinity;  this  occurs  becuase  P  [N  (t)=n]-*-0  (any  n)  if  N  is 
Poisson. 

Proof  of  Corollary:  We  return  to  property  (b')  (i.e.,  (3.15),  which  is 
valid  under  the  stated  hypothesis.  This  equation  is  rewritten  in  terms 
of  conditional  expectations  as 
c  n. 

I  (-ri)  {E[r.  (Z(t)  )  |N(t)=n-e.  ]  -  E  [r .  (Z  (t) )  ]  } 
i=l  Ai  1  11 

(3.20) 

c 

-  t{  £  E [r . (Z (t) ) |N(t)=n]  -A}, 
i»l  1 

in  which  we  have  also  used  (3.12)  to  express  the  ratio  between 
P[N(t)*n-eil  and  P[N(t)*n],  and  have  been  able  to  assign  arbitrary 
values  to  probabilities  conditioned  on  {N(t)*n-e^}  when  n^*0.  Since 
the  r^  are  necessarily  bounded  because  they  are  in  the  range  of  the 
infinitesimal  operator,  the  left  side  of  (3.20)  is  also  bounded  in 
t  for  each  fixed  n.  Hence  (3.19)  follows.  a 

We  conclude  our  discussion  by  observing  that  the  necessarily 

*Note  that  the  second  equality  of  (b+)  contains  (a).  Take  n*ke  •  ,  so 
that  only  the  j  terms  remain.  Then  sum  over  k;  the  result  is  3 
Elr^ (Z (t) ) J-Aj ,  as  required. 
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infinite  sets  of  equalities  established  thus  far  can  be  simplified — 

at  least  in  principle — through  the  introduction  of  generating  functions 

To  this  end,  we  determine  the  generating  function  version  of  the 

infinite  set  of  integral  equations  (3.5)  and  (3.6)  under  the  assumption 

that  N  is  Poisson  as  previously  supposed.  Actually,  it  is  easier  to 

work  with  the  differential  equations  (3.16),  multiplying  both  sides  by 
ni 

y=IIy  and  summing  over  n.  For  convenience,  we  let  z^=l-y^,  and  con¬ 
fine  ourselves  to  z*  (z^jZj* • • • ,  zc)  satisfying  1 1— z ^ | < 1  for  each  i.  We 
take 

c  N.(t) 

G.  (z)  -  E[  n  (1-z.)  1  ]  (3.21) 

C  i*l  1 

which  equals  exp [-tE ( A^z^) ]  by  the  Poisson  assumption,  so  that  the  time 

A  A 

derivative  of  G.  (z)  becomes  2A ,z.G.  (z) .  Further,  we  define 

w  li  X  V 

C  N  (t) 

G..(z)  *  E[  n  (1-z.)  1  I  r .  ( Z  ( t)  )  1  .  (3.22) 

i»l  1  3 

With  this  notation,  the  infinite  set  of  equations  (3.16)  [equivalent 
to  (3.5)  and  (3.6)]  becomes 


i=l 


Xizi[Gti(2)  ' 


Gt(z)]  * 


(3.23) 


The  significance  of  this  equation  is  recognized  in 

Corollary  3.5:  Condition  (b')  of  Theorem  3.3  is  equivalent  to  (3. 23). a 
Although  (3.23)  "looks  neater"  than  (b1)  [cf.  (3.15)],  it  is  no 
more  susceptible  to  simplification.  It  is  only  in  the  case  of  the 
single  stream  (i.e.,  c=l) ,  that  (3.23)  [and  for  that  matter,  conditions 
(b*) ,  (b')  or  (b+) ]  reduce  to  the  independence  statement  of  Theorem  2.7 
which  in  combination  with  (a)  is  equivalent  to  a  Poisson  N. 
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